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CHAPTER  1 
INTRODUCTION 

Most  control  design  methods  require  a  complete  characterization 
of  the  process  to  be  controlled  and  its  environment.  Often  in  realistic 
settings,  this  knowledge  is  not  directly  available.  One  method  to  overcome 
this  difficulty  is  to  use  an  adaptive  controller.  Intuitively,  an  adaptive 
controller  can  adjust  its  behavior  to  various  plants  or  disturbances. 
Although  there  are  many  types  of  adaptive  systems,  most  can  be  decomposed 
into  two  loops  as  shown  in  Figure  1.1.  The  inner  loop  contains  a  plant  and 
an  ordinary  regulator,  while  the  outer  loop  adjusts  the  regulator  to  achieve 
some  performance  goal.  A  class  of  adaptive  systems,  model  reference 
adaptive  systems,  incorporate  a  reference  model  in  the  outer  loop.  The 
response  of  the  inner  loop  is  adjusted  so  the  plant  output  tracks  the 
reference  model  output . 

One  of  the  simpler  discrete  model  reference  adaptive  systems  is 
the  one  step  ahead  adaptive  controller  presented  by  Goodwin  (1984) .  The 
inner  loop  contains  a  plant  which  will  be  modelled  as 

A(q_1)y(k)  =  q"1B(q_1)u(k)  +  w(k)  (1.1) 

where  u(k)  and  y(k)  are  the  input  and  output,  respectively,  A(q-^)  and 
B(q  *")  are  polynomials  of  unknown  degree,  and  (w(k)  }  is  a  sequence 
which  may  depend  upon  (u(k) }  and  (y(k)}.  Note  that  (w(k) }  may  contain 
unmodeled  dynamics  as  well  as  disturbances.  The  nominal  plant  is  given  when 
w(k)  *  0  Vk.  The  regulator  is  represented  by 

♦(k) '  ©(k)  -  ym(k+d)  (1.2) 


& 


c 

r 

v 
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> (k)  =  (u(k) ,u(k-l) , . . „ ,u(k-m-d+l) ,y(k) ,y(k-l) , . . . ,y(k-n+l) ) 

=  (u(k)  j  <J>_(k) 


®(k) "  =  (80<k),...,Sm+d_1(k),i0(k),...^n_1(k)-  =  (eQ(k)  j  6  (k)') 

where  y^Ck+l)  is  the  reference  model  output  known  one  step  in  advance 
parameter  update  is  done  using  a  projection  algorithm 

.  y  (k)  0  (k— d)  (y  (k)  -  ©(k-1) 'A(k-d) ) 


'  1  +  Y(kH(k-d)  <Kk-d) 

where  y(k)  is  a  scalar  adaptation  gain.  With  y(k) equals  zero,  the  parameters 
are  held  constant  and  the  system  is  linear  time  invariant  as  shown  in 
Figure  1.2.  The  tracking  transfer  function  is  the  transfer  function  from 
y^fk)  to  y (k)  with  constant  parameters.  Although  the  stability  properties 
of  the  system  with  constant  parameters  are  well  known,  many  issues  are 
unresolved  once  parameter  adaptation  is  allowed. 

Goodwin,  Ramadge  and  Caines  (1980)  proved  the  system  signals  are 
bounded  and  the  tracking  error  tends  to  zero  if  three  assumptions  are  made. 
First,  they  assumed  the  plant  was  disturbance-free,  which  in  our  case 
corresponds  to  w(k)  =0,  Vk.  Second,  the  plant  was  assumed  to  be  minimum 
phase.  Without  this  assumption  unstable  unobservable  modes  could  appear 
in  the  system  if  a  controller  pole  cancelled  an  unstable  zero.  Finally, 
it  was  assumed  that  there  existed  a  set  of  constant  parameters  for  which 
the  tracking  transfer  function  was  identically  one.  This  condition  is 
commonly  referred  to  as  matchability .  Because  most  industrial  processes 
violate  one  or  more  of  these  assumptions,  more  general  results  are  needed. 

Egardt  (1983)  extended  the  result  of  Goodwin,  Ramadge  and  Caines 
(1980)  to  plants  with  bounded  disturbances  by  projecting  the  parameters  into 


a  compact  set  to  ensure  their  boundedness.  Praly  (1983)  was  able  to  extend 
Egardt's  results  to  the  case  where 


|w(k) |  <  6  s(k)  +  w 

s(k)  ■  u  s(k-l)  +  max(|  4>(k-d)  |  SA) 

A  >  0  ,  0  <  u  <  1  (1.5) 

when  6  is  sufficiently  small  by  taking 

y  (k)  =  — ~  .  (1.6) 

s(k)0 

In  Praly  (1984)  ,  global  stability  is  shown  if  there  exists  a  constant 
parameter  vector  ©*  for  which  the  tracking  transfer  function  has  the  following 
two  properties: 

1.  The  Nyquist  plot  of  its  causal  part  lies  entirely  within  a 
circle  of  radius  1  and  center  1.  This  is  a  conlcity  condition. 

2.  The  noncausal  part  is  sufficiently  small. 

The  above  results  have  not  made  any  assumptions  concerning  the 
model  reference  output  or  the  initial  parameter  values.  If  the  initial 
regulator  parameters  result  in  a  stable  closed-loop  system  and  the  speed 
of  convergence  is  not  vital,  then  slow  adaptation  may  be  used.  In  slow 
adaptation  the  parameter  update  gain,  >(k),  is  small,  and  if  y(k)  is 
sufficiently  small,  the  system  approximates  a  linear  time  invariant  system. 

As  an  extension  of  the  work  of  Anderson  and  Johnson  (1982)  ,  Kosut 
and  Anderson  (1984),  Astrom  (1984),  Krause  (1983),  Anderson,  Bitmead,  Johnson 
and  Kosut  (1984),  Riedle  and  Kokotovic  ( 1984),  Kokotovic ,  Riedle  and  Pralv 
(1985),...  on  the  stability  of  error  models,  it  has  been  established  in 
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Riedle,  Praly  and  Kokotovic  (±985),  that  if  y( k)  is  small,  the  conicity 
condition  mentioned  previously  can  be  relaxed  to  a  signal  dependent  conicity 
condition.  More  explicity,  the  conicity  condition  can  be  replaced  with  the 
condition  that  the  transfer  function  evaluated  only  at  frequencies  contained 
in  the  reference  model  output  must  lie  in  a  circle  of  radius  1  and  center  1. 

In  Chapter  2  a  new  matching  condition  is  developed  to  ensure  the 
local  stability  of  the  one  step  ahead  adaptive  controller  for  slow  adaptation. 
It  is  assumed  that  there  exists  a  constant  parameter  vector  ©*  such  that 
the  tracking  transfer  function  is  equal  to  one  at  the  frequencies  contained 
in  a  particular  { ym ( k.) }  called  a  test  reference  output.  Then,  it  is  shown 
that  the  adaptive  system  is  robust  to  disturbances  of  the  type  described 
in  Equation  (1.5)  and  small  bounded  disturbances  in  the  test  reference  output. 

Advances  in  computer  technology  have  lead  to  the  widespread  use  of 
sampled  data  systems.  Unfortunately,  many  of  the  stability  results  for 
discrete  time  adaptive  controllers  are  not  applicable  to  sampled  data  systems. 
The  problem  arises  in  that  the  equivalent  discrete  time  model  for  a  sampled 
continuous  plant  may  have  nonrainimum  phase  zeros  even  if  the  plant  is 
minimum  phase.  In  fact,  M'Saad  et  al.  (1985)  state  that  it  is  more  of  a  rule 
than  an  exception  for  the  discrete  system  to  have  nonminimum  phase  zeros. 

As  a  result  there  is  a  need  for  discrete  adaptive  algorithms  which 
can  tolerate  plants  with  nonrainimum  phase  zeros.  M'Saad  et  al.  (1985)  gives 
a  comprehensive  review  of  the  literature  dealing  with  such  systems. 

In  most  discrete  reference  model  adaptive  systems,  the  controller 


poles  cancel  the  plant  zeros  to  attain  exact  matching  of  the  plant  and 
reference  outputs.  If  the  plant  has  a  nonminimum  phase  zero,  the  cancellation 
will  lead  to  unobservable  unstable  system  modes.  Clearly  the  controller  must 


not  cancel  the  unstable  zero.  One  solution  is  to  retain  the  nonminimum  phase 
zero  in  the  closed  loop  tracking  transfer  function.  Johansson  (1985)  has 
established  that  the  minimum  a  priori  knowledge  required  is  the  unstable 
zero  positions.  Fortunately,  Astrom,  Hagander  and  Stemby  (1984)  have 
established  the  unstable  zero  positions  for  rapidly  sampled  continuous 
systems.  They  stated  that  for  a  continuous  plant  with  n  poles  and  m  zeros: 

1.  The  sampled-data  representation  of  the  system  will  have 
n-1  zeros  and  n  poles;  and,  furthermore, 

2.  As  the  sampling  period  tends  to  zero,  m  zeros  tend 
to  1  and  are  stable.  The  remaining  n-m-1  zeros  tend 

to  known  values  which  depend  upon  only  the  relative  degree 
n-m,  and  if  they  are  unstable,  they  are  real  and  lie  on 
the  interval  (-°°,-lJ. 

Explicit  use  of  this  knowledge  in  an  indirect  scheme  has  been  proposed  by 
Clarv  and  Franklin  (1984). 

In  Chapter  3  a  direct  adaptive  controller  is  proposed  which 
assumes  knowledge  of  the  unstable  zeros  and  retains  them  in  the  tracking 
transfer  function.  A  global  convergence  analysis  is  presented  for  a 
disturbance-free  plant,  assuming  matchabilitv .  The  chapter  finishes  with 
a  discussion  of  the  strengths  and  weaknesses  of  the  algorithm. 

In  Chapter  4  some  concluding  remarks  and  suggestions  for  further 
research  are  offered. 


CHAPTER  2 


LOCAL  STABILITY  OF  A  TUNED  SOLUTION 

This  chapter  develops  an  alternative  matchability  condition  which 
will  assure  the  local  stability  of  a  one  step  ahead  adaptive  controller  for 
slow  adaptation.  First,  the  system  and  its  equilibrium  point  are  precisely 
defined.  Then  a  nonlinear  incremental  model  is  formed.  The  incremental 
model  is  used  to  show  that  the  linearized  system  is  exponentially  stable 
for  the  nominal  plant.  This  result  is  then  extended  to  derive  a  local 
stability  result  for  the  full  system. 


2.1.  Preliminaries 

In  this  section,  an  equivalent  representation  of  the  system  is 
presented.  With  this  representation,  the  tuning  condition  is  defined  and 
an  incremental  model  is  formed.  This  incremental  model  is  the  subject  of 
the  analysis  presented  in  the  following  sections. 

A  more  useful  jepresentation  of  the  plant  (1.3)  will  be  the 
nonminimal  state  space  representation  defined  as 


X(k+1)  =  FX(k)  +  GlU(k)  +  G2w(k) 


y(k)  =  h'X(k) 


►  *. 

\ 


(2.1) 


J  * 
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If  Equations  (2.2)  and  (2.3)  are  substituted  into  Equation  (1.2),  the 
control  u(k)  can  be  written  explicitly  as 

U(10  -  [-  etOO'JX(k)  +  ym(k«)l  •  <2-4> 

For  slow  adaptation,  y(k)  is  set  to  a  small  constant  denoted  by  e.  It 
follows  that  the  complete  closed-loop  adaptive  system  can  be  written  as 

G.4  (k)-J  G 

X(k+1)  -  [F  -  -~r - ]X(k)  +  y  (k+d)  +  G_  w(k) 

6(k)  S(k) 

e(w  .  mx-i)  +  •  (2.5) 

This  system  is  highly  nonlinear.  In  order  to  facilitate  its  study  we  now 
introduce  the  notion  of  a  tuned  solution.  This  will  allow  us  to  derive  a  more 
practical  equivalent  representation. 

Definition:  A  test  reference  output  is  an  N-periodic  sequence  {y  (k) }  for  which 
"  m 

ft  ft  ft 

there  exists  an  N-periodic  sequence  {X  (k)}and  constant  9  with  S  ^0  satisfying 


i) 


X* (k+1)  -  (F  -  ■  )X*(k)  +  y*(k+d)  ,  Vk 

X*(k)  '(h  -  re*)  -  0 


(2.6) 

(2.7) 


ii)  All  eigenvalues  of 

GlVJ 

<F 


(2.8) 


are  strictly  inside  the  circle. 

Equation  (2.7)  is  called  the  tuning  condition.  In  the  appendix  we  show  that 

this  condition  is  generically  satisfied  if  y*(k)  does  not  contain  more  than 

m 

*  * 

(m+d+n/2)  frequencies.  (9  ,X  (k))  is  called  the  tuned  solution  of  the 
adaptive  system. 


.•> 


*■  mJL  ^  *- 


The  tuned  solution  represents  an  equilibrium  of  the  adaptive  system 


with  y*(k+d)  as  the  input.  For  notational  convenience  let 


4>*(k-d)  -  HX*(k) 


♦  *00  =  JX*(k) 


(2.9) 

(2.10) 


To  continue  with  the  analysis,  the  existence  of  an  equilibrium  must  be 
assumed . 

Assumption  A1 :  For  the  nominal  plant  there  exists  a  test  reference  output 
(y>)}. 

Nonlinear  Incremental  Model:  The  analysis  is  now  focussed  upon  the  behavior 
of  system  (2.5)  around  the  tuned  solution.  For  this  purpose,  define  the 
incremental  variables  x(k)  and  @(k)  as 

x (k)  =  X(k)  -  X*(k)  (2.11) 

e<k)  =  e(k)  -  e*  .  (2.12) 


The  actual  output  reference  y  (k)  is  obtained  from  the  test  output 

m 

reference  y*(k)  by 

y  (k)  =  y*(k)  +  v(k)  ,  (2.13) 

m  m 

where  (v(k) }  is  a  sequence  satisfying 


sup  | v(k) |  <  v  .  (2 . 14) 

k 


Substituting  (2 . 11) -(2 . 14)  into  (2.5)  the  following  equivalent  incremental 


form  is  obtained: 
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"x(k+l)n 

•  M(k,e) 

x(kr 

+  G 

'v(k+d)“ 

+ 

~RX (©(k) ,x(k) ,v(k+d) ,k) 

9(k)_ 

_9(k-l)_ 

.  w<k>  . 

_eRQ(6(k-l) ,x(k) ,k) 

,  (2.15) 


where: 


M(k,e) 


- 

*•« 

-1 

r  e*J 

G. 

I 

0 

0 

I  +  e$*(k-d)  $*(k-d)  ' 

e$*(k-d)  (h'-e*^) 

I 

_ 

F  g2 


Rx(©(k),x(k),v(k+d)k)  -  ’l  e('k)')~[(3*0r(k)  ‘ 


*  vB(k)  * 


3(k)©r)  '(  g*  4>r(k)  -  Jx(W> 


Rg(6(k-1) ,x(k) ,k) 


-  S(k)(v(k+d)  -  y*(k+d))] 

H _ fr ,  T  e(X(k)  +  X*(k))TTHv  ... . 

1  +  eX(k)  "H  'HX(k)  Ll  u  "  1  +  eX*(k)  "H'HX*(k)  ' 

( (9* 'H-h')x(k)  +  b*(k-dmk-l))]  +  X(k)x(k)  "H"©(k-1) )  ] . 


The  remainder  of  this  chapter  is  devoted  to  proving  the  local 
stability  of  (2.15)  around  the  origin.  The  incremental  model  is  equivalent 
to  the  one  step  ahead  adaptive  controller  of  Equations  (2.5).  Two  types  of 
disturbances  are  considered. 

Reference  output  perturbations  are  characterized  by  the  bounded 
sequence  v(k) ,  and  deviations  of  the  plant  from  nominal  are  represented  by 
w(k) .  The  following  assumption  will  allow  the  analysis  to  encompass  a  wide 
class  of  unmodeled  effects. 
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Assumption  A 2:  The  sequence  w(k)  satisfies 


where 


|w(k)  I  <  <5(s(k)  +  w) 


s(k)  -  ps(k-l)  +  j X(k) | 


6  >  0  ,  w  >  0 


0  <  p  <  1 


2.2.  Exponential  Stability  of  the  Linear  System 

As  a  step  towards  the  local  analysis  of  (2.15),  we  consider  the 
following  linear  time  varying  system: 


x(k+l) 

®(k) 


M(k,E) 


x(k) 

©(k-l) 


(2.16) 


In  the  following  theorem,  established  in  Riedle  et  al .  (1985),  we  take 
advantage  of  the  structure  of  the  matrix  M(k,e)  and  the  presence  of  the  small 
parameter  e  (the  adaptation  gain) . 

Let  vQ(k)  be  the  unique  N-periodic  output  of  the  following  system: 

g  e*M  g1  * 

Lo(k+l)  -  (F  -  -^|_)Lo(k)  -  *  (k)' 

vo(k)  -  -  (h'  -  e;H)Lo(k)  +  /(k-d)' 

Theorem  1:  Under  Assumption  Al,  if  the  real  parts  of  the  eigenvalues  of 

N-l  * 

Z  (k-d)v  (k) 
k-0  0 

are  strictly  positive,  then  there  exists  an  zq  >  0  such  that  for  any  e, 

0  <  z  <  e  there  exist  a  c(e)  and  p(e)  such  that 
-  o 


1  n  M(j )  |  <  c  p 
j-i+i 


k-i 


by  the  change  of  variables 

z(k)  -  x(k)  -  L(k,  e )0(k-l) 

where  M(k,e)  is  a  lower  triangular  matrix .  The  existence  of  the  sequence  of 
matrices  (L(k,e)}  which  allows  this  transformation  is  provided  by  the  following 
lemma: 

Lemma:  Under  the  assumptions  of  the  Theorem,  there  exists  an  >  0  such  that 
for  any  e,  0  <  e  <  e^,  the  sequence  (L(k,e)}  exists  with  the  following 
properties : 

i)  L(k,e)  is  K-periodic  in  k; 

ii)  L(k,e  )  *  LQ(k)  +  eL^(k,e)  where  L^(k,c)  is  K-periodic  and 
bounded ; 

iii)  The  matrix  M(k,e),  defined  above, is  K-periodic  and  can  be  written 


M(k,e) 


“u<k,e>  0 

M21(k,e)  M22 (k,e) 


and  there  exists  c^(e),  P^(e)  such  that: 


1  n  M  (j,£)|<c  0;J 

j-i+1  11  11 


Proof :  We  write  the  nonlinear  recursive  equation  satisfied  by  L(k,e) .  Then 
the  existence  of  a  unique  K-periodic  solution  is  shown  using  the  contraction 
mapping  theorem. 


As  a  consequence  of  this  lemma ,  the  proof  of  the  theorem  Is  reduced 


to  the  study  of  M^Ck.e).  It  can  be  shown  that 

M22(k,e)  -  I  -  e$*(k-d)vQ(k) '  +  e^^k.e) 

where  M22(k,e)  Is  bounded.  The  conclusion  follows  easily  by  noticing  that 

N-i  N-l  *  , 

n  iL,(k)  -  I  -  e  I  <b  (k-d)v  (k)  '  +  e  M 
k-0  "  k-0  ° 

This  implies  for  some  constant  m: 

N-l  -  2- 

|  II  M22(k)j  <  1  -  ea  +  e  m  <1 
k-0 

where  the  last  inequality  is  obtained  for  e  small  enough  and 

N-l  * 

Re  A,(  s  <t>  (k-d)v  (k) ')  >  a  Vi 

1  ,  _  o 

k-0 

This  also  shows  that  a  meaningful  approximation  for  p  (as  e  tends  to  zero)  is 

N-l  * 

p  -  1  -  e  Min  Re  X . (  E  $  (k-d)v  (k) ')  .  ° 

i  1  k-0  0 

To  complete  our  analysis  of  the  linear  system  (3.1)  we  need  to  show 
that  the  assumption  of  Theorem  1  is  satisfied.  This  is  done  with  the  following 
property  which  is  proved  in  the  appendix. 

Property  1:  Under  Assumption  Al,  we  have 

vQ(k)  -  <p*  (k-d)  ,  Vk 

* 

It  follows  that  Theorem  1  holds  provided  we  make  an  assumption  on  $  (k-d) . 
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Assumption  A3;  The  test  reference  output  y^(k)  is  such  that  the  corresponding 
tuned  solution  satisfies 

N-1  *  * 

I  <j>  (k)4>  (k)  '  >  a  I  a  >  0 
k=0 

This  is  the  classical  persistence  of  excitation  assumption.  In  the  appendix 
we  show  this  condition  is  equivalent  to  the  uniqueness  of  the  tuned  solution. 

Under  this  assumption  and  for  slow  enough  adaptation,  the  linear 
system  (2.16)  is  exponentially  stable. 


2.3.  Local  Stability  of  the  Adaptive  System 

As  a  well-known  consequence  of  the  uniform  asymptotic  stability  of 

the  linear  system  we  have  the  following  robustness  result : 

Theorem  2 :  Under  Assumptions  Al,  A2  and  A3  there  exists  an  eq  such  that  for 

any  e,  0  <  e  <  e  there  exist  N  (e) ,  v  (e)  and  6  (e)  such  that  if 
—  o  o  o  o 

|X(0)  -  X  (0)|  +  J0(O)-0  |  <  NQ(e),  then  for  any  k,  v  <  vQ(e)  and  5  <  6q (e ) 
we  have  |X(k)  -  X  (k)|  +  |0(k)  -  0*|  <  N  for  some  constant  N. 

Proof :  This  type  of  result  is  known  in  a  very  general  continuous-time 
context  (for  example  see  Theorem  5.2,  Chapter  X  of  Hale  (1980)).  Here  we 
present  a  proof  adapted  to  our  particular  problem  in  discrete  time.  Let 
Y(k+1)  be  the  complete  state  of  system  (2.15).  By  the  variation  of  constants 


formula,  we  have 


Y ( k+1 ) 


n  M(i)Y(o)  +  i  n 
i=0  i=0  j*i+l 


M(i) 


'vU+djN  /  R  (©(i),x(i),v(i+d),i 


w(i)/  XeRgCeCi-l)  ,x(i)  ,i) 


We  define 


(2. 


N(k)  -  | Y (k) j 

Let  e,c,p  be  given  by  Theorem  1,  then  we  can  write  with  simplified  notation: 
N(k+1)  <  CtpVo)  +  Z  pk”i[|G|  ( |v(i+d)  |  +  |w(i)|)  +  |R  (i)|  +e|fU(i)|] 

i-0 

The  proof  proceeds  by  induction.  We  assume. 


N(i)  <  N  Vi  0  <  i  <  k 


The  objective  is  to  show  this  implies 

N(k+1)  <  N 

with  an  appropriate  choice  of  N. 

Bound  on  w(i) :  By  Assumption  A2  ; 

|w(i) |  <  5(s(i)  +  w) 

i  i-i-1 

s(i)  •  u  s(0)  +  E  u  J 

j-0 


|X(j)|  ,  0  <  U  <  1 


We  also  have 


| X(j ) |  <  sup  |X  (k)|  +  |x(j)| 

k 

<  sup  |X*(k) |  +  N(j) 

k 


Therefore,  with  the  induction  assumption, 

sup|X*(k)|  +  N 
k 


s(i)  <  s  + 
-  o 


1  -  W 


This  implies 


|w(i)  |  <  (N  +  w*) 


0  <  i  <  k 


with 

w*  *  sup  |X*(j)|  +  (w  +  sq) (1  -  u) 

I  6*1 

Bound  on  R^.RqJ  Assuming  that  |6(k)|  <  ^  *  and  using  the  Schwartz  and 
triangle  inequalities,  it  is  easy  to  derive  from  the  expressions  for  Rx  and 
Rq  the  following  inequalties  : 


|Rx(i)|  <  vN(i)P3(N(i))  +  N2(i)P4(N(i)) 

IV1)!  -  N2(i)Px(N(i)) 

Where  P^ ,  P3  and  P^  are  polynomials  with  positive  coefficients  of  degree  1 
3  and  4,  respectively.  These  polynomials  are  increasing  functions  of  N(k) 
(N(k)  >  0).  For  any  N  >  N  we  conclude  by  the  induction  assumption: 


P i (N(i) )  <  P (N)  ,  J-1,3,4 


0  <  i  <  k 


It  follows  that  a  nondecreasing  function,  K(N) ,  can  be  found  such  that,  if 
I B(k) |  <  j  0*/2  j  then, 

|Rx(i)|  +£1^(1)!  <  K(N)(vN  +  N2)  ,  0  <  i  <  k  ,  N  <  N 


Substituting  these  bounds  into  Equation  (4.1)  gives 


,r,  6  w  iGld  K(N)v 

N(k+1)  <  C[(pNq  +  <v0  +  +  ((1-P)  (l-w)  +  (l-o) 


■)N  + 


K(N)N2 

(1-P)J 


Therefore,  N(k+1)  will  be  smaller  than  N  if 
* 


C(  (pNQ  + 


IGI6 


(vo  +  1-U  }  +  ((l-p)(l-w) 


K(N)v  „,„.M2 

°-)N  +  *225-] 


1-p 


1-p 


-  N  <  0 


This  inequality  has  a  solution  in  N  iff  the  following  discriminant  is 
nonnegative, 


CIGI6 


(-  1  + 


(1-p) (1-p) 


C  K(N)v  2  4R(N)C  2 
1-p  ’  ~  1-p 


(  N  +  ~  (v  +  -2- — )  <  0 
O  1“P  o  1—U 


Clearly,  if  vq,  oq,  Nq  are  sufficiently  small  the  inequality  will  be  satisfied 
To  ensure  N<N  and  |8(k)|  <  (with  j  S  (k)  |  <  N),  note  that  K(N)  is  an 

increasing  function  of  N,and  as  K(N)  increases,  N  will  decrease. 


2.4.  Simulations 

Through  the  use  of  several  examples,  this  section  demonstrates  a 
variety  of  disturbances  which  satisfy  Assumption  A2 .  These  disturbances 


are  applied  to  a  nominal  system  and  the  system  is  simulated. 


Nominal  System:  For  the  ease  of  analysis  a  second  order  plant  with  delay  1 
was  chosen  as  nominal.  This  plant  is  represented  by 


(1  +  a^  1  +  a2q  2)y(k)  =  q1^  +  b2q  1)u(k) 


With  m=0  and  n=l  from  Equation  2.4  .he  control  is  written  as 


u(k)  = 


ym(k-kl)  -  a(k)y(k) 


Too* 


(2. 


For  constant  6  and  a,  the  closed-loop  tracking  transfer  function  is 


y*'l>  - 


vb2  -i 

-r-  +  -5-  z 


1  +  (a^  +  b^  ^)z  ^  +  (az  +  b2  ^)z 


(2, 


In  the  appendix,  it  is  shown  that  a  test  reference  output  ym(k) 
must  have  less  than  (m+d+n)/2  frequencies.  For  this  system  it  is 
sufficient  to  let  Ym(k)  contain  a  single  frequency.  Hence,  yra(k)  can  be 
represented  by 

ym(k)  =  e^k  =  cos(ftk)  +  j  sin(ftk)  .  (2. 

Given  ft,  the  controller  parameters  which  satisfy  the  tuning  condition  can 
be  found  by  substituting  Equation  (2.21)  into  (2.19)  and  setting  T^(z  ) 
equal  to  unity.  After  some  manipulations,  the  parameters  are  found  to  be 


c^  =  sin(I2)  +  sin(2ft) 
c 2  =  b^  sin(Jl)  +  b2  sin(2ft) 

=  t>2  sl-n(^) 

c^  =  1  +  a^  cos(fi)  +  a2  cos  (2fi) 
cos(Sl)  +  b2  cos(2ft) 
c^  =  b^  +  b2  cos(ft) 

«A>  ^  | 

For  y  (k)  to  be  a  test  reference  output,  the  poles  of  T  (z  )  must 
m  y 

be  stable.  The  characteristic  equation  for  T^(z  is 


P(z  1) 


1  +  (a.  +  b.  2_M)z-1 
1  1  8  («) 


,  ,  ,  a  (n),  -2 

+  (a  +  b„  — - )z 

8  (fl) 


(2.23) 


*  * 

It  is  important  to  note  that  because  a  (fi)  and  6  (fi)  appear  only  as  a 
ratio  in  Equation  (2.23),  the  stability  of  T^(z  is  determined  by  this 
ratio.  The  stability  of  P(z  "*’)  can  be  determined  by  using  the  Jury  test. 
Example  2.1:  In  this  example,  the  nominal  system  is  simulated.  The  following 
plant  coefficients  are  used: 


These  coefficients  produce  plant  poles  at  1.1  and  -0.9  and  a  plant  zero 

at  1.5.  With  0  *  0.4,  a  *  0  were  calculated  to  be  1.3503  and  1.12475, 

respectively.  With  these  parameters,  T^(z  has  poles  at 

-1  * 

-0.3165± j  0.3991.  Clearly,  T^(z  )  is  stable  and  ym  is  a  test  reference 
output.  Notice  that  even  though  the  plant  is  nonminimin  phase,  a  test 
reference  output  exists.  This  shows  Assumption  A1  does  not  imply  the 
plant  must  be  nonminimum  phase. 

This  system  was  simulated  with  a(0)  =  6(0)  =  1.0,  e  =  1.0, 

&  =  0.4  and  the  plant  initial  conditions  at  zero.  The  trajectories  of 
ct(k)  and  0(k)  are  shown  in  Figure  2.1.  In  this  disturbance-free  case  the 
parameters  converged  to  their  correct  values  nicely. 

Unless  stated  otherwise,  the  system  used  in  Example  2.1  will  be 
used  in  the  following  examples  with  the  same  parameters  and  initial 
conditions. 

Example  2.2:  In  this  example,  a  disturbance  is  added  through  the  reference 
model  input.  This  disturbance  was  denoted  by  v(k)  in  the  analysis  and  will 
be  a  single  sinusoid  in  this  example.  For  f2  *  2.5,  Equations  (2.21)  and 
(2.22)  yields  an  a(fi)  and  6(ft)  of  -2.24091  and  -1.1866,  respectively. 
Substituting  these  parameters  into  Equation  (2.19)  yields  an  unstable  T^(z 
so  this  frequency  cannot  be  a  test  reference  output.  In  the  second 
simulation,  v(k)  was  set  to  be  0.25  cos(2.5k).  The  trajectories  of  ot(k) 
and  B(k)  are  shown  in  Figure  2.2.  As  expected,  the  parameter  values  do  not 
converge,  since  the  controller  does  not  have  enough  freedom  to  satisfy 
matchability . 

Example  2.3:  This  example  is  the  first  of  three  examples  to  demonstrate  the 
versatility  of  Assumption  A2  in  modelling  parasitics,  nonlinearities,  etc. 


In  this  example  the  disturbance  considered  is  an  unmodelled  pole  near  the 
origin.  Let  the  nominal  plant  be  represented  by 


A(q  1)y(k)  *  B(q  1)u(k) 


and  the  perturbed  plant  by 


A(q  1)  (1  +  <$q  1)y(k)  *  B(q  1)u(k) 


where  6  is  some  small  constant. 

Equation  (2.24)  can  be  manipulated  into 


A(q  1)y(k)  *  B (q  1)u(k)  -  6q  1A(q  1)y(k) 


The  perturbed  plant  can  be  written  as 


A(q  1)y(k)  =  B (q  1)u(k)  +  w(k) 


where  w(k)  is 

w(k)  = 

w(k)  = 


-  6 q  1A(q  1)y(k) 


-6  E  a.  y(k-i) 
i=l  1 


(2 ,2‘ 


(2.2! 


(2.2< 


(2.2 

(2.21 


Introducing  0  <  u  <  1,  and  using  Cauchy-Schwarz, 

nA 

|w(k) |  <  6  maxjp1  k  a  |  E  jy(k-i) |yk  1 

i=l 

This  expression  shows  clearly  that  a  disturbance  introduced  by  an  unmodelled 
pole  near  the  origin  satisfies  Assumption  A2 .  For  the  simulation,  a  pole 
at  0,2  was  placed  into  the  plant.  The  trajectories  of  the  parameters  for 


Example  2.4:  In  this  example,  some  nonlinearities  are  shown  to  satisfy 
Assumption  A 2.  To  simplify  the  analysis,  assume  the  plant  with  a  small 
nonlinearity  can  be  written  as 


A(q  1)y(k)  *  q  1B(q  1)f(u(k)) 

A(q_1)y(k)  =  q"1B(q'1)u(k)  +  q'Vq"1)  (f  (u(k) )  -  u(k)) 
This  implies  w(k)  is 

w(k)  =  q_1B(q_1)(f(u(k))  -  u(k) 


Using  the  Cauchy-Schwarz  inequality, 


|w(k) |  <  L  | f (u(k) )  -  u(k) ||b . | 
i=l 


Introducing  0  <  y  ^  1, 
nB 

| w(k)  j  <  I  lik‘1|f(u(k))  -  u(k)  |  |ui_k  b  | 
i=l 

nB 

|w(k) ]  <  maxly1  b. |  E  u  1|f(u(k))  -  u(k) 

i=l 


If 

|  f  (u(k) )  -  u(k)  |  <  <5 1  u(k)  |  +  w  , 

then  w(k)  will  satisfy  Assumption  A2.  For  the  simulation,  f (u(k) )  was 


defined  as 


f(u(k)) 


u(k)  +  0.2u(k) 

1  +  u(k) 2 

The  parameter  trajectories  are  given  in  Figure  2.4. 

Example  2.5:  To  conclude  this  section,  a  small  time  variation  in  the 
parameters  is  shown  to  be  encompassed  by  Assumption  2.  For  this  example 
let  the  plant  be  represented  by 

nA 

y(k)  =  q  '*‘B(q  ^)u(k)  -  Z  a.y(k-i)(l  +  0.2  sin(fi  k)  ,  (2. 

i-1  S 

where  is  the  frequency  of  the  parameters.  Clearly,  a  slight 
rearrangement  of  Equation  (2.34)  yields 

nA 

w(k)  =  -  0.2  Z  a.y(k-i)sin(ft  k) 
i-1  1  S 

This  equation  is  very  similar  to  Equation  (2.28).  Hence,  w(k)  satisfies 
Assumption  A 2.  Again,  the  parameter  trajectories  are  presented  in 
Figure  2.5. 


2.5.  Discussion 

The  analysis  presented  has  shown  the  local  stability  of  the 
adaptive  system  about  a  tuned  solution.  This  stability  was  found  to  be 
robust  to  a  broad  class  of  disturbances  in  both  the  plant  and  the  reference 
output.  Through  the  use  of  several  examples,  it  was  demonstrated  that 
bounded  disturbances,  neglected  poles  or  zeros  near  the  origin,  slight 
nonlinearities  and  some  time  variations  satisfy  Assumption  A2. 


500. 


Also, during  the  simulations,  several  characteristics  of  the  system 
were  noticed.  First,  the  system  exhibited  very  strong  stability  properties. 
With  e  large  and  with  large  disturbances  the  simulations  remained  stable. 
These  properties  may  be  due  to  the  fact  that  the  plant  used  in  the 
simulation  was  only  second  order.  One  characteristic  second  order  systems 
have  that  higher  order  systems  do  not  have  is  that  the  set  of  characteristic 
equation  coefficients  which  yield  a  stable  system  is  convex.  Another 
characteristic  of  the  simulations  was  that  some  disturbances  seemed  to 
shift  the  equilibrium  parameter  values.  Perhaps  a  better  understanding  of 
this  phenomena  would  give  some  more  insight  into  the  system  performance. 
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CHAPTER  3 


A  DIRECT  ADAPTIVE  SCHEME  FOR  SAMPLED  DATA  SYSTEMS 


In  this  chapter  a  direct  adaptive  scheme  suitable  for  a  sampled 
continuous  process  is  presented.  As  mentioned  in  the  introduction,  as  the 
sampling  interval  is  reduced  to  zero,  the  zeros  of  the  equivalent  discrete 
model  approach  known  values.  The  adaptive  algorithm  proposed  assumes  the 
unstable  zeros  are  exactly  known,  and  to  simplify  the  analysis,  the  plant 
is  assumed  linear  and  disturbance  free.  With  these  assumptions,  a  parametric 
model  is  derived  to  retain  the  unstable  zeros  in  the  tracking  transfer 
function.  These  parameters  are  estimated  using  a  least  squares  algorithm 
augmented  by  projecting  the  parameters  onto  a  convex  set.  Global  convergence 
for  the  algorithm  is  established  via  an  analysis  similar  to  that  used  in 
Goodwin  et  al.  (1980).  The  chapter  concludes  with  a  discussion  of  the 
weaknesses  and  strengths  of  the  algorithm. 


3.1.  System  Reparametrization 


To  establish  the  notation,  the  aforementioned  assumptions  are 
precisely  stated. 

Assumption  A4:  The  sampled-data  system  may  be  represented  by 

A(q  1)y(t)  =  q  1B^(q  1)B(q  1)u(t)  (3, 

where  A(q  ,  B(q  and  B^(q  are  polynomials  in  the  backward  shift 
operator  q  ^ ;  A(q  is  monic  and  A(q  and  B^(q  are  relatively  prime; 


(3.1) 
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B (q  1)  describes  the  stable  zeros  and  the  sign  of  its  leading  coefficient 
is  known  (say,  positive);  ly(t)  }  and  (u(t)}  are  the  output  and  input 
sequences,  respectively,  of  the  sampled  system. 

Assumption  A5:  Integers  n  and  m  are  known  such  that 

n  >  deg  A(q  "S  and  m  >  deg  B(q 

Assumption  A6:  B^(q  is  known,  has  degree  d,  and  may  include  the  system 

delays.  The  unstable  zeros  represented  by  B^(q  will  be  denoted  by  z  , 

where  i=l  to  d.  For  the  purposes  of  this  paper,  we  shall  assume  that  all 

z  ,  are  real, 
ui 

With  these  assumptions  the  parametric  model  given  by  Johansson  in 
Chapter  5  of  Johansson  (1983)  is  derived. 

In  order  to  maintain  consistency  with  the  continuous  time  approach, 
observer  poles  are  introduced.  Let 

N  =  max{n,m  +  d  +  l} 

be  the  number  of  such  poles.  Let  C(q  S  and  T(q  ^)  ,  of  degree  d+1  and  N, 
respectively,  be  polynomials  with  stable  zeros.  The  relative  primeness  of 
A(q  "*■)  and  B^(q  "S  implies  that  there  exist  polynomials  S(q  ^)  and  R(q  *) 
of  degree  N-m  and  N-l ,  respectively,  such  that 

A(q"1)S(q'1)  +  q"1Bu(q"1)q"1R(q_1)  =  C(q'1)T(q~1)  .  (3.2) 

Applying  (3.2)  to  y(t)  yields 

C(q"1)T(q"1)y(t)  =  q"1(S(q"1)Bu(q_1)u(t)  +  q"1R(q"1)Bu(q'1)y(t) )  , 


(3.3) 


(3.8 


which  implies  that  the  control  law  is 


r  ( t)  =  6T4>(t)  .  (3.9) 

Examination  of  (3.2)  will  show  that,  since  C(q  ^)  and  T(q  “S  are 

stable,  S(q  ^)  and  B^(q  "L)  are  relatively  prime.  This  implies  that  S(q  *) 

and  B^(q  “S  are  prime.  This  fact  motivates  the  next  assumption. 

N 

Assumption  A7 :  A  convex  set  CC  1R  is  known  such  that 

1.  the  vector  of  coefficients  of  S(q  ^)  belongs  to  C,  and 

2.  for  any  polynomial  S'(q  ^)  corresponding  to  any  vector  in  C, 

|  S ' (z_1  ) |  >  e  ,  1  <  i  <  d 

and 

liml  S '  (2  ■*■)  I  =  lb'  I  >  s 
'o' 

z-*°° 

Examination  of  the  regression  vector  d> ( t )  ,  parameter  vector  9,  and 
control  law  (3.9)  reveals  the  fact  that  S(q  ^)  will  be  the  denominator  of  the 
controller.  Since  this  controller  is  a  sampled  data  version  of  a  continuous¬ 
time  controller,  as  the  sampling  period  goes  to  zero,  the  poles  of  this 
controller  tend  to  1;  moreover,  the  zeros  of  the  system,  z^v  are  fa  (-“,-1]. 
The  convex  set  C  of  assumption, therefore ,  can  be  described  by  the  following 

inequalities  (using  b  >  e)  : 

o 

S'(z  ))  >  £  ,  1  ^  i  <  d 

ui  - 

lim  S'(z  b  =  b'  >  £ 

O  “ 

Z-*co 

Now,  since  R(q  ^)  and  S(q  'S  are  unknown,  an  adaptive  control  algorithm 
is  proposed. 


Let  0(t)  be  an  estimate  of  0  and  define  as 


“Is 


¥>(t)  *  B^(q  ) d> <t ) 


(3.10 


The  algorithm  is 


0(t)  =  P-(0(t-l)  + 


P(t-2)l(t-l) 


1  +  (t-1)  P(t-2)v)  (t-1) 


(C(q"1)y(t)-0(t-l)T^(t-l)) 


(3.11 


where  P^  is  the  projection  on  C  proposed  on  page  92  of  Goodwin  and  Sin  (1984) 


P(t-l)  =  P(t-2)  - 


P(t-2)l (t-l)l (t-1)  P(t-2) 


(3.12 


i  +  v>(t-irp(t-2)*(t-D 


P(0)  >  0  ; 

r(t)  -  9(t)T4»(t)  .  (3.13 

The  use  of  the  projection  P^  guarantees  that  the  polynomial  S(q  \t) 
obtained  from  0(t)  satisfies  the  condition  that 

I S (Zui * t) I  >  £  »  1  1  1  t  d 

and 

lim|S(z  \t)  |  >  e 

Z-*» 


3.3.  Convergence  of  the  Algorithm 

The  following  theorem  gives  the  properties  of  the  algorithm. 

Theorem  3:  Under  the  Assumptions  A4  through  A7 ,  the  algorithm  described  by 
(3.11),  (3.12),  and  (3.13)  has  the  properties 


1.  0(t)  is  bounded, 


2.  u(t)  and  y(t)  are  bounded  for  bounded  r(t),  and 

3.  lim[C(q~1)y(t)  -  q  ^(q  1)r(t)]  =  0. 

t-H* 

Proof :  We  shall  use  the  techniques  of  proof  introduced  by  Goodwin,  Ramadge 
and  Caines  (1980).  The  presence  of  B^(q  ^) ,  however,  will  impose  some 
additional  difficulties.  We  shall  first  state  some  technical  lemma  stating 
the  properties  of  the  estimation  used  in  the  algorithm. 

Lemma  1 :  Under  the  aforementioned  assumptions, 

1.  |0(t*  -  6|  <  K  ,  for  all  t; 

2.  lim | C(q_1)y(t)  -  e<t)T*(t-l)|  -  0; 

3.  limj 9(t)  -  0 (t-1) |  =  0. 

Proof :  See  Goodwin  and  Sin  (1984)  Lemma  3.3.6. 

Lemma  2  s  Let  P(q  \t)  and  Q(q  1,t)  be  polynomials  with  degree  np,  n^, 
q^(t)  (j  = 0  to  n^)  such  that  p^(t)  and  q^(t)  are  bounded  and  satisfy 

lim|q  (t)  -  q  (t-1) |  =  0 
^  J 

For  any  sequence  v(t) ,  let  F(P,Q,v,t)  be  the  sequence  defined  by 
F(P,Q,v,t)  =  P (q  1,t)[Q(q  1,t)u(t)]  -  [P(q  1,t)Q(q  1,t)]u(t)  ,  (3. 

where  the  first  terra  on  the  right-hand  side  implies  P(q  \t)  operates  on 
Q(q  \t)u(t),  while  the  second  terra  implies  that  the  product  [P(q  \t) 

A(q  ^,t)]  operates  on  u(t).  Then  for  any  e  >  0,  there  exists  a  T  such  that, 
for  all  t  >  T 

|  F(P ,Q ,v,  t)  |  <  ePn  (n  -  l)n  sup  |v(t-£)|  (3. 

P  p  4  0<2.<n  +n 


p  >  lpt(t)l 


Vt,0  <  i  <  n 
-  -  P 


Proof ;  See  Goodwin  and  Sin  (1984)  Lemma  4.3.2. 


Lemma  3 :  If 


S(zui,t)|  >  e  ,  1  ;  1  i  i  . 


lim)S(z  ,t) j  >  e  , 

2-x» 

then  there  exist  time-varying  polynomials  ct(q  \t)  and  8(q  \t)  such  that 
[a(q"1,t)S(q"1,t)]  +  [g(q"1,t)q'1Bu(q'1) ]  =  1 
and  the  coefficients  of  a(q  \t)  and  0(q  \t)  are  bounded. 

Proof :  The  hypothesis  on  S(q  \t)  implies  that  S(q  \t)  and  q  ^B^q  *)  are 

relatively  prime  for  any  t.  Existence  of  a(q  \t)  and  0(q  \t)  follows 

_i  -1  -1 

from  the  Bezout  identity;  moreover,  the  Bezoutian  of  S(q  ,t)  and  q  B^(q  ) 
is  (see  Kailath  (1980),  Example  2.4-17,  page  159) 


§  (t)  •  n  S  (z  "t) 
o  .  ,  ui 

1=1 


which  is  uniformly  bounded  from  below.  This  implies  the  boundedness  of  the 
coefficients  of  a(q  \t)  and  8(q  \t). 

Before  proceeding  further,  lr  s  note  that  there  is  no  finite 
escape  time,  since  the  mapping  from  t  to  t+1  has  no  singularity.  In 
particular,  the  projection  operation  in  the  control  algorithm  implies  that 
no  division  by  zero  will  occur.  The  proof  of  the  theorem  will  now  be  done 


using  the  small  gain  theorem: 


V 


Forward  path:  u(t)-»y(t):  Let  n(t)  be  defined  by 


n(t)  =  C(q  1)y(t)  -  e(t)T^(t-i) 


=  C(q-1)y(t)  -  6 (t)TBu(q-1)d>(t-l) 


Adding  and  subtracting  Bu(q  )r(t-l)  to  (3.16)  and  using  the  definition  of 


the  control  law  (3.13)  yields 


C(q-1)y(t)  =  n(t)  +  q"1Bu(q"1)r(t)  +  0(t)T[Bu(q  1)q>(t-l)  ] 
-  Bu(q“1)[8(t-l)T^(t-l)] 


Now,  for  any  e,  let  Tq  be  a  finite  time  given  by  Lemmas  1  and  2, 

such  that 


n(t)  <  e 


for  all  t  >  T 
-  o 


sup  | C(q  1)y(t)|  <  e  +  K  sup  |B  (q  1)r(t-l)  |  +  eK_  sup  J<t>(t-l)S, 

T>t>T  ”  T>t>T  T>t>T 

__0  --o  --o 


for  some  constants  and  K^.  The  finite  nature  of  the  SL^  gains  of 
C(q  )  ^  and  T(q  ^)  ^  then  imply  that 


sup  |y(t) I  <  e  +  eK^  sup  |u(t-l)|  +  eK^  sup  ] y ( t  —1 / J  +  , 

T>t>T  ~  T>t>T  T>t>T  5 

(3 


for  some  constants  K^,  and  K^.  The  fact  that  there  is  no  finite  escape 
time  then  implies  that 


sup  I  y (t )  I  <  -. - -jr-  sup 

T>t>T  5  T>t>T 

-  -  o  -  -  o 


sup  |u(t)  I  +  K-, 


for  some  K-, 


Feedback  path:  y(t)-»-u(t): 

Let  a(q  \t)  and  g(q  ^,t)  be  two  time  varying  polynomials  defined 
below.  Applying  g(q  \t)  to  (1)  and  applying  a(q  \t)B(q  1)T(q  1)  to  (3.13) 
result  in  the  following  two  equations: 

[g(q'1,t)A(q'1)]y(t)  -  [S(q"1,t)B(q'1)q"1Bu(q‘1)]u(t)  (3.2 

[a(q‘1,t)B(q‘1)T(q_1)]r(t)  =  (a(q_1 , t) B(q_1) T(q_1) ] 9 (t)T<» (t)  .  (3.2 

Let  R(q  \t)  and  S(q  \t)  be  defined  as  those  polynomials  whose 
respective  coefficients  are  those  coefficients  in  9(t).  With  a(q  \t) , 

S  (q  \t)  related  to  R(q  \t)  and  S(q  \t)  by  Lemma  3,  Equation  (3.23)  may  be 
rewritten  as 

(a(q  1 ,t) B(q  1)T(q  X)]r(t)  =  [a(q  1,t)B(q  1)][S(q  1,t)u(t)  +  R(q  \t)y(t) 

+  T(q_1)  [0  (t)Tq,  (t)  ]  -  9(t)TtT(q_1)d>(t)  ]  ]  .  (3.2 


Summing  respective  sides  of  (3.22)  and  (3.24)  and  applying  Lemma  e  yields 
the  equality 

[ct(q"1,t)B(q*1)T(q"1)]r(t)  +  [8(q"1  ,t)A(q_1)  ]y(t)  =  B(q_1)u(t) 

+  (a(q  1  ,t)B(q  1)  ]  [R(q-1 , t) y(t)  +  T(q  1)  [0(t)T(p(t) 


-  9  ( t ) T  [  T  (q~ 1 )  <(>  ( t )  ]  ]  +  [a(q"1,t)B(q"1)][S(q“1,t)u(t)] 


-  [a(q  1 ,t)B(q  1) S(q"1 ,t) ]u(t) 


(3.2 


B(q  )u(t)  *  [a(q  ,t)B(q  )T(q  )Jr(t)  +  [B(q  st)A(q  )]y(t) 

-  [a(q‘1)t)B(q'1)][R(q'1,t)y(t)  +  Kq'1)  [0  (t)  T<(,(t)  ] 

-  0  (t)  T[T(q_1)  <j)  (t)  ]  ]  +  [a(q‘1st)B(q'1)][S(q_1,t)u(t)] 


-  [a(q  1,t)B(q  1)S(q  1,t)]u(t) 


(3.26) 


B (q  ■*■)  ^  has  a  finite  i^-gain  and  we  have  no  escape  time;  with  the 

lemmas  we  can  find  a  such  that 

sup  |  u  ( t )  j  <  Kg  +  Kg  sup  1  y  (t)  |  +  eK.q  sup  |  T  ( q  1)  4>  (t )  | 

T>t>T  ~  T^t>T1  1  T>t>T. 


+  eK...  sup  |u(t) 
T>t>T^ 


(3.27) 


for  some  constants  KQ ,  K  ,  K  _  and  K.. .  . 

O  y  1U  11 

Since  T(q  ^)  *  has  a  finite  i^-gain,  Equation  (3.27)  may  be 
rewritten  as 


sup  |u(t) |  <  K2  +  K  sup  |y(t)|  +  eK...  sup  | u ( t ) |  (3.28) 

T^T1  ~  T>t>T1  T>t>Tx 

for  some  constants  K^  >  and  K.^ .  Equation  (3.28)  implies  that 


sup  I  U  ( t )  j  <  T - “77 sup 

T^t^T1  ”  14  T>t>T^ 


sup  |  y (t)  j  +  K 


(3.29) 


for  some  constant  K^. 
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Closing  the  loop:  The  boundedness  of  u(t)  and  y(t)  follows  from  application  *“~ 

of  the  Small  Gain  Theorem  to  (3.21)  and  (3.29)  with  a  choice  of  e  such  that 

r.' 

£K4  .  K13  ;  . 

1  -  eK.  1  -  eK,  ,  1 

5  14 

We  may  now  conclude  from  (3.17)  that 

lim  [c(q  1)y(t)  -  q  LB  (q  1)r(t)]  =  0 
t-+°°  u 


3.4.  Discussion 

As  mentioned  previously,  the  stability  analysis  in  Section  3.3  is 
similar  to  the  proof  presented  in  Goodwin  et  al.  (1980).  As  a  result. 

Theorem  2  has  many  of  the  same  restrictive  assumptions  which  handicap  the 
Goodwin,  Ramadge  and  Caines  stability  result.  In  particular,  Assumptions 
A4  and  A5  of  Theorem  2  limit  the  analysis  to  disturbance-free  linear  time 
invariant  plants  with  known  order.  Since  most  industrial  processes  do  not 
meet  these  assumptions,  further  work  is  needed  to  relax  these  assumptions. 

Assumptions  A6  and  A7  are  unique  to  this  algorithm  and  are  required 
to  cope  with  the  nonminimum  phase  zeros.  Assumption  A6  assumes  knowledge  of 
the  unstable  zero  locations,  while  Assumption  A7  enables  the  projection 
operator  in  the  algorithm  to  prevent  the  controller  from  cancelling  the 
unstable  zeros.  Although  the  nonminimum  phase  zeros  are  known  as  the 
sampling  rate  tends  to  zero,  practical  considerations  will  limit  the  speed  of 
sampling  and,  the  zero  locations  will  be  unknown.  This  limitation  motivates 
future  research  into  the  robustness  of  the  algorithm  with  respect  to 
uncertainties  in  the  zero  locations. 


■V* 


*1 


Although  the  analysis  applies  only  to  a  nominal  plant,  Theorem  2 
represents  a  very  strong  stability  result.  This  result  states  that  not  only 
will  the  parameters  and  signals  remain  bounded,  but  also,  the  tracking  error 
will  tend  to  zero  for  all  initial  conditions.  Another  important  feature  of 
the  analysis  is  that  the  proof  of  Theorem  2  relies  upon  the  convergence 
properties  of  the  estimator  instead  of  its  structure.  Therefore,  if  the 
least  squares  estimator  is  replaced  by  any  scheme  for  which  Lemma  1  is  valid. 
Theorem  2  will  hold.  This  is  very  important  in  applications,  because  often 
the  least  squares  estimator  is  modified  to  compensate  for  slowly  varying 
plants  or  disturbances.  Goodwin  and  Sin  (1980)  list  many  common  modifications 
and  their  convergence  properties. 
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CHAPTER  4 
CONCLUSIONS 

*\ 

In  this  thesis  two  stability  results  are  developed  for  one  step 
ahead  adaptive  controllers.  In  Chapter  2  an  analysis  is  presented  of  the 
local  behavior  of  a  one  step  ahead  adaptive  controller  around  a  tuned 
solution.  Instead  of  placing  assumptions  on  the  order,  delay  or  minimum 
phase  properties  of  the  plant,  the  existence  of  a  unique  tuned  solution  is 
assumed.  This  implies  that  for  a  particular  reference  model  output  there 
exists  a  unique  stabilizing  parameter  vector  such  that  the  plant  output 
will  track  the  reference  model  output  exactly.  Assuming  this  tuned  solution 
exists,  the  closed- loop  system  was  shown  to  be  locally  stable,  and  small 
departures  from  the  nominal  do  not  disturb  this  stability. 

In  the  appendix  the  existence  of  a  unique  tuned  solution  is 
shown  to  be  equivalent  to  the  classical  persistence  of  excitation. 
Furthermore,  the  examples  of  Section  2.4  have  shown  that  a  unique  tuned 
solution  does  not  imply  the  plant  is  minimum  phase.  It  is  clear  that  the 
assumption  of  the  existence  of  a  unique  tuned  solution  has  not  been  fully 
analyzed,  and  further  research  is  needed  to  ascertain  all  the  implications 
of  such  an  assumption. 

The  second  stability  result  presented  in  this  thesis  deals  with 
the  problems  associated  with  direct  adaptive  control  of  a  sampled  data 
process.  Even  if  a  continuous  time  plant  is  minimum  phase,  sampling  will 
often  introduce  nonminimum  phase  zeros  in  the  equivalent  discrete  model. 
These  nonminimum  phase  zeros  cannot  be  cancelled  if  system  stability  is 


V  . 


•V 


to  be  maintained.  Johansson  (1983)  has  shown  that  the  minimum  a  priori 
knowledge  needed  is  the  unstable  zero  locations.  Fortunately,  Astrom  et  al. 
(1984)  have  estabilished  the  location  of  these  zeros  for  very  rapidly 
sampled  systems.  Using  this  information,  the  algorithm  presented  in 
Section  3.2  retains  the  unstable  zeros  in  the  tracking  transfer  function. 

The  analysis  presented  in  Section  3.3  represents  the  first  step 
towards  establishing  a  robust  direct  adaptive  scheme  for  sampled  data 
systems.  Assuming  the  zero  locations  are  known,  the  analysis  in  Section  3.3 
shows  that  the  system  will  have  bounded  signals  and  parameters  and  that  the 
tracking  error  will  go  to  zero.  Unfortunately,  in  practical  situations  the 
sampling  rate  is  limited,  and  therefore,  the  exact  zero  locations  are  not 
known.  Furthermore,  industrial  processes  are  seldom  disturbance-free. 

These  weaknesses  in  the  analysis  motivate  further  research  into 
the  robustness  of  the  algorithm  with  respect  to  plant  disturbances  and 
errors  in  the  unstable  zero  locations. 


APPENDIX 


PROPERTIES  OF  THE  TUNED  SOLUTION 


The  test  reference  output  ym(k)  was  defined  to  be  N-periodic,  as 


a  consequence  it  can  be  represented  as 

N„ 


*  *  k 

y_00  =  2  y  z 

m  i— Nx  “i  1 


Vk 


with 


N1  -  2  N  »  n2  -  \  (N  -  1}  »  zi  =  exp(j^) 


_* 


^m,-i  ymi 


— *  * 

where  is  the  complex  conjugate  of  y  . 


In  the  following  we  denote  by  E  the  set 


E  =  U  :  ymi  ^  0} 


The  number  of  elements  in  E  is  denoted  by  n_,  0  can  be  decomposed  into 

Ci 


e  *  (e  ,e  ,...,Bm+d_1,a0,...,ari_1) 


Denote  by  6(z  and  a(z  the  polynomials  in  z  ^  with  coefficients 


*  * 

£$i’  respectively.  It  can  be  seen  from  Figure  1.2  that  the  characteristic 


polynomial  of  the  tuned  closed-loop  system  is 


P(z  S  *  A(z  ^)S(z  ^)  +  z  ■''BCz  '*')a(z  "S 


-1, 


Defining  V(z  )  as 


V(z  *■)  *  (A(z  ^),...,z  m  A(z  ,z  ^(z  z  °B(z  ^))'  , 


the  characteristic  polynomial  can  be  rewritten  as 


P(z  )  =  V(z  ) '  © 


With  this  expression  for  the  characteristic  polynomials  some  properties 
of  the  tuning  condition  can  be  stated. 

Property  Al:  If 

BCz"1)  +  0  ,  Vi6  E 

Then  the  tuning  condition  is  equivalent  to  the  following  linear  system: 

zf'1  BCz'1)  =  VCz"1)'  6*  ,  Vi6E 

Corollary  Al :  Under  the  same  assumption  the  tuning  condition  is  satisfied 
iff 


OUz'1))'  €  Range  (VCz"1)  ') 

iGE  i€E 

Corollary  Al  shows  that  the  tuning  condition  is  satisfied  generically  if 


n  <  m  +  d  +  n 

As  a  consequence,  can  contain  no  more  than  — <~-+-  —  frequencies. 

Proof  :  From  (2.7), the  tuning  condition  can  be  written  as 

y  (k)  =  ©*  q:  (k-d)  ,  Vk  , 

and  using  (1.2), the  control  is  obtained  from 

y*(k+d)  =  ©*V<k)  ,  Vk 

*  * 

Since  0  is  a  constant,  it  follows  readily  that 

y*(k)  =  y*00  »  Vk 
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*  * 

Now  let  Ty(z  )  be  the  transfer  function  between  ym(k+d)  and  y  (k) 
From  the  state  space  representation,  we  have: 

!  eT  1  G1 

t  { *  i  m  -  (V  -  r.  3L_  m  -=■ 


T  (z  *)  -  h'(zl  -  (F  -  G.  — *£-  J))  — j 

y  .  i  ft* 


And  from  a  classical  computation, 

I  (z-1)  - 

y  P(z  *) 


*  * 

The  identity  of  the  sequences  {y  (k) }  and  {y  (k) }  yields 

m 

1  yl(*?T  (^T1)  -  -  o  ,  vk 

i€  £  mi  1  y  1  1 

But  since  the  sequences  {z^},  i€E  are  linearly  independent,  this  relation 
shows  that  the  tuning  condition  implies 

ZiTy(zi1)  ’  1  *  0  *  Vi€  E 


d-1. 

B(zt  ) 

IT  * 
V(zii)'9 


-1  =  0  ,  Vi  €  E 


-1  -1 

But  we  know  that  8(2^  )  is  not  zero,  therefore,  V(z^  )'©  is  not  zero, 
We  have  obtained  the  following  necessary  condition: 


zi~]‘B(zi1)  " 


Clearly,  this  is  also  a  sufficient  condition. 


Vi  €  E 


-  .  - .  •  .  - .  - .  • .  • 

.  •  •  »  *  0  -  ‘  *  •  '  e  "»  •  "  ■  v  ■ 

^ 


> 


eWStow, 


Corollary  A 2 :  Under  Assumption  Al, 

(u*(k-d)}  -  ^(q’1)  (u*(k)}  ,  {y*(k-d)>  =  Ty(q_1)  {y*(k) } 

proof :  The  second  relation  has  already  been  established.  For  the  first  one, 
we  notice  that  u*(k)  is  the  N-periodic  output  of  an  exponentially  stable  linear 

it  * 

system  (thanks  to  Assumption  Al)  with  y^(k)  as  input.  Therefore,  u  (k)  can 
also  be  written  as 

u*(k)  »  E  u.  zj  ,  Vk 
i€E 

The  conclusion  follows  from  the  identity 

V'i1*  ’  *1*  ’  *1£E 


Property  A 2 :  If  the  tuning  condition  is  satisfied  and 


BU^1)  *  0  ,  VISE 


Then  uniqueness  of  ©  and  persistence  of  excitation  (Assumption  A3)  are 


equivalent  properties, 
o 

wl  it 

Proof:  Let  T  (z~;  be  the  transfer  function  between  y  (k+d)  and  u  (k)  ,  we  have 
-  u '  m 

_  ,  -1,  A(z_1) 

V2  5 

P(z  ) 


_1  *  * 

Let  Tx(z  )  be  the  transfer  function  between  y  (k+d)  and  4>  (k) 
<p  m 

From  the  state  representation,  we  have 

0  G 

T.  (z  )  -  z  H(zl  -  (F  -  G,  J))"1  ~ 

<P  1  B  8 


*  -1 

But  also  comparing  the  definitions  of  $  (k)  and  v(z  )  and  using  the  expression 


50 


) 


) 

) 


This  expression  allows  us  to  rewrite  the  persistence  of  excitation  condition 
In  the  frequency  domain  as 


N-l  *  * 

S  *  (k)t  00 

k«0 


2  u 

i€  E 


*  ,2  V(2IX) 

mi ' 


I2 


*  -1 

Both  ymi  and  P(zi  )  are  not  equal  to  zero  for  i£E,  therefore,  the  fact 

that  this  matrix  is  positive  definite  is  equivalent  to  the  fact  that 

the  matrix  (v(z  )  is  full  rank.  But  with  Property  A1  we  know  that 

i  e  E 

this  is  equivalent  to  the  uniqueness  of  0  . 

Let  us  now  prove  Property  Al. 

* 

Lemma:  For  any  ©  ,  we  have  the  following  identity: 

©*"  G 

©  'H(zl  -  (F  -  G.  J))'L  ~  -  z 

1  g*  8 

Proof:  This  transfer  function  is  iust  z  d©  T.(z  where  T,(z  )  is  defined 

-  <t>  <P 

in  the  proof  of  Property  A2.  Since  we  have 


y*'1) 


v(.z~h 

V(z-1)'©* 


9 


the  conclusion  follows  readily. 

Now  to  prove  Property  Al,  we  have  to  show  that  the  transfer  function 

©*'  G 

H(z_1)  -  z"d  +  (h'  -  ©;H)(zI  -  (F  -  G.  J))"1 

x  8  8 

it 

with  (k) }  as  input,  has  {$  (k-d)}  as  an  output.  From  this  lemma,  we  can 
rewrite  H(z~^)  simply  as 
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